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(54) Sound control device and sound control method 

(57) Game sounds produced by a video game ma- 
chine are classified into those emitted from left and right 
speaker units of a television receiver and those emitted 
from a head set worn by a player. The emission of the 
individual game sounds from the speaker units or a 
sound emissive portion of the head set is controlled in 
correspondence with game screens or scenes. This al- 
lows the player to enjoy the video game while hearing 
footsteps or whispering from a leading character closely 
from the head set, and hearing explosive sound or 
shouts of enemy characters distantly from the speaker 
units. 



FIG. 1 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 5 

[0001] The present invention relates to sound control 
devices and sound control methods. 

2. Description of the Related Art 10 

[0002] In recent years, there is widely popularized an 
video game machine for executing a video game based 
on a game program which is stored in a storage medium 
such as CD-ROM, DVD-ROM and semiconductor mem- 15 
ory. 

[0003] Such video game machine is designed to allow 
a player to manipulate a game character that appears 
on a display screen through operating a controller 
plugged into the main unit of the video game machine. 
Thus the player can enjoy a variety of video games in- 
cluding RPG (Role Playing Game), AVG (Adventure 
Game) and SLG (Simulation Game). 
[0004] Most of recent video games are designed in 
pursuit of reality and presence, and various efforts have 
been made from the graphical aspect typically by apply- 
ing three-dimensional computer graphics technology. 
[0005] Most of such efforts for adding reality and pres- 
ence of video games, however, have placed an empha- 
sis on the visual aspect of the player such that illustrating 
more realistic characters and objects of the game, and 
have placed only a little emphasis on the auditory aspect 
of the player up to now. 

[0006] Generation and emission of more real game 
sounds would be one possible measure for improving 
reality and presence of video games to a certain extent, 
but as far as television receiver is used as a monitor 
device, all game sounds such as characters' voices or 
effective sounds are audible from fixed speaker units 
provided as a sound emitter of the television receiver. 
[0007] So that the emitted sound had difficulty to have 
perspective, which has resulted in limited reality and 
presence of video games. 

SUMMARY OF THE INVENTION 

[0008] Various aspects and features of the present in- 
vention are defined in the appended claims. 
[0009] Embodiments of the present invention relate to 
sound control devices, sound control methods, compu- 
ter-readable storage media having recorded therein a 
sound control program to be executed on a computer, 
program execution devices for executing the sound con- 
trol program and sound control programs, to be execut- 
ed on a computer; all of which are preferably but not 
exclusively applicable to video game machines and en- 
tertainment systems having video game function. 
[0010] The present invention was proposed to ad- 



dress the foregoing problem. To this end, embodiments 
of the present invention can provide a sound control de- 
vice, a sound control method, a computer-readable stor- 
age medium having recorded therein a sound control 
program to be executed on a computer, a program ex- 
ecution device for executing the sound control program 
and a sound control program to be executed on a com- 
puter; all of which are aimed at providing perspective t6 
the emissive sound and improving reality and presence 
of video games. 

[0011] In the present invention, emission of predeter- 
mined sounds such as effective sound and a back- 
ground music of the game, among whole sounds related 
to a video game, are controlled through the first sound 
emissive unit provided at a predetermined distance from 
a player, and emission of sounds other than the above, 
such as characters' voices, are controlled through the 
second sound emissive unit provided close to a player* 
s ear, to thereby ensure perspective of the game sounds 
and thus improve reality and presence of the game. 
[0012] Further particular and preferred aspects of the 
present invention are set out in the accompanying inde- 
pendent and dependent claims. Features of the depend- 
ent claims may be combined with features of the inde- 
pendent claims as appropriate, and in combinations oth- 
er than those explicitly set out in the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] The invention will now be described by way of 
example with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
ences, and in which: 

Fig. 1 is a perspective view of an entertainment de- 
vice according to an embodiment of the present in- 
vention; 

Fig. 2 is a block diagram of the entertainment device 
of the embodiment; 

Fig. 3 is a schematic chart showing exemplary 
sound data of a video game run on the entertain- 
ment system of the embodiment; 
Fig. 4 is a schematic drawing showing a player play- 
ing a battle-type video game run on the entertain- 
ment system of the embodiment; 
Fig. 5 is a schematic drawing of an exemplary game 
scene in which a leading character repulses an en- 
emy character; and 

Fig. 6 is a flow chart showing a process flow of 
sound emission control executed on the entertain- 
ment system of the embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0014] Various embodiments of the present invention 
will be described with reference to the accompanying 
drawings. It is to be noted that the same or similar ref- 
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erence numerals are applied to the same or similar parts 
and elements throughout the drawings , and the descrip- 
tion of the same or similar parts and elements will be 
omitted or simplified. 

[001 5] The present invention is applicable, for exam- 
ple, to an entertainment system as shown in Fig. 1 

General Constitution of En tertainment System 

[0016] The entertainment system shown in Fig. 1 
comprises a main unit 1 for executing a battle-type video 
game described later, a controller 2 for operating a char- 
acter in the video game, a head set 3 for collecting play- 
er's voice to be transferred to the main unit 1 and for 
emitting characters' voices sent from the main unit 1, 
and a television receiver 40 including a display screen 
41 for displaying game scenes of the video game and 
left and right speaker units 42R, 42L for emitting game 
sounds. 

Constitution of main unit 

[001 7] The main unit 1 is provided with a reset button 
4 for specifying reset of operations of such main unit 1 , 
two USB (universal serial bus) connection terminals 5, 
an IEEE 1394 (Institute of Electrical and Electronics En- 
gineers) connection terminal 6, controller ports 7A, 7B 
to which a controller 2 is connected, and memory card 
slots 8A, 8B allowing connection of the head set 3 and 
a memory card for storing details of the play up to a point 
of time the playing of the video game will be interrupted. 
[0018] Themainunitl is provided also with a disk tray 
9 for loading onto the main unit 1 an optical disk 130 
such as CD-ROM and DVD-ROM which stores, for ex- 
ample, a game program of the video game, sound infor- 
mation such as characters' voices and effective sounds, 
and music information such as a background music 
(BGM) of such video game; and an eject button 10 for 
specifying ejection of the optical disk 1'30 loaded onto 
the disk tray 9. 

[0019] While not illustrated in the drawing, on the 
backside of the main unit 1 , provided are a power switch, 
audio/video output terminal (AV multi-output terminal), 
a PC card slot, an optical digital output terminal, and an 
AC power input terminal. The television receiver 40 for 
monitoring is connected to the main unit 1 through the 
AV multi-output terminal, so as to allow game scenes of 
the video game to be displayed thereon, and to allow 
game sounds such as characters' voices, effective 
sounds and BGM to be audible from the left and right 
speaker units 42R, 42L. 

Constitution of Controller 



[0020] The controller 2 has a left grip end 35 held as 
being covered by the player's left palm; a right grip end 
36 held as being covered by the player's right palm; left 
operational portion 21 and a right operational portion 22 



operable by the individual thumbs of the left and right 
hands holding the grip ends 35, 36, respectively; a left 
analog operational portion 31 and a right analog opera- 
tional portion 32 operable again by the left and right 
5 thumbs, respectively, in an analog manner (joy stick op- 
eration); a first left press button 23L and a first right 
press button 23R operable by the left and right first fin- 
gers, respectively; and a second left press button and a 
second right press button provided just below the first 
10 left press button 23L and the first right press button 23R, 
respectively, and operable by the left and right middle 
fingers, although not shown. 

[0021] The left operational portion 21 is provided with 
"upward", "downward", "leftward" and "rightward" direc- 
ts tional keys used by the player for moving for example a 
game character, upward, downward, leftward or right- 
ward. The "upward", "downward", "leftward" and "right- 
ward" directional keys are also capable of specifying 
syntheLic directions, so that pressing the "upward" di- 
20 rectional key and the "rightward" directional key at the 
same time can issue an instruction for moving obliquely 
right upward. The same will apply to the other directional 
keys, and pressing, for example, the "downward" direc- 
tional key and the "leftward" directional key at the same 
25 time can issue an instruction for moving obliquely left 
downward. 

[0022] The right operational portion 22 is provided 
with four buttons ("A", "x" and "Or buttons having 
thereon embossed markings of A, □, X and O, respec- 
30 tively), which are assigned with functions, such as set- 
ting and execution of functions of game characters, dif- 
fered by game application programs. 
[0023] The left analog operational portion 31 and the 
right analog operational portion 32 are designed to keep 
35 upright posture (not-inclined posture) and remain in 
such position (referential position) when they are not in- 
clined for operation, but when they are inclined for op- 
eration, a coordinate value on an X-Y coordinate is de- 
tected based on the amount and direction of the inclina- 
40 tion from the referential position, and such coordinate 
value is supplied as an operational output to the mam 
unit 1 .. 

[0024] The controller 2 is also provided with a mode 
selection button 33 for toggling analog mode and digital 
45 mode, an illumination display portion 34 for informing, 
typically through illumination of LED (light emitting di- 
ode), the player of a current operational mode selected 
using such mode selection button 33, a start button 24 
for prompting the game start, reproduction start and 
so temporary stop, and a selection button 25 for issuing in- 
struction for allowing the television receiver 40 to display 
thereon a menu or an operational panel. 
[0025] When the analog operational mode is selected 
using the mode selection button 33, the illumination dis- 
ss play portion 34 is controlled to light on to thereby activate 
the left and right analog operational portions 31 , 32, and 
when the digital mode is selected, the illumination dis- 
play portion 34 is controlled to turn off to thereby inacti- 
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vate the left and right analog operational portions 31 , 32. 
[0026] In the left and right grip ends 35 ; 36, a motor 
having a weight decentered from the axis of rotation (vi- 
bration generation mechanism) is provided. Rotational 
operation of the motor is controlled based on an instruc- 
tion from the main unit 1 when the game character gets 
some damage. This applies vibration to the player's 
hands holding the controller 2 to thereby enhance pleas- 
ure of the game play. 

[0027] The controller 2 is connected to the main unit 
1 by plugging a controller connection portion 12 into the 
controller port 7A or 7B, and can, upon receiving oper- 
ation signals generated corresponding to operation of 
various buttons or operational portions by the player, 
send such operation signals to the main unit 1 through 
a cable 19, the controller connection portion 12 and the 
controller port 7A (or controller port 7B). 

Constitution of Head Set 

[0028] The head set 3 is typically designed for single- 
ear use, and has a fitting arm 1 5 for fitting the head set 
3 onto the player's head, a sound emissive portion 16 
provided at an end of the fitting arm 1 5 and is responsi- 
ble for emitting characters' voices and effective sounds, 
and a microphone 17 for picking up the player's voice. 
[0029] The fitting arm 15 is designed in a curved 
shape so as to fit the human head profile, and so as to 
lightly press both sides of the player's head with both 
ends thereof, to thereby attach the head set 3 onto the 
player's head. 

[0030] The sound emissive portion 1 6 has a pad por- 
tion 16a which can cover the entire portion of the play- 
er's right (or left) ear when the head set 3 is fitted on the 
player's head, and a speaker unit 1 6b for emitting effec- 
tive sounds and so forth of the video game. The pad 
portion 1 6a is composed, for example, of a soft material 
such as sponge so as to avoid pain on the player's ear 
caused by prolonged wearing of such head set 3. 
[003t] The microphone 17 is provided on the end of 
a microphone arm 1 7a, the opposite end of which being 
attached to the sound emissive portion 1 6. The micro- 
phone 1 7 is designed to be positioned close to the play- 
er's mouth when the head set 3 is fitted on the player's 
head, which is convenient for picking up player's voice 
and supplying sound signals corresponding thereto 
through a cable 18 to the main unit 1 . 
[0032] The head set 3 is connected through the cable 
18 and a head set connection portion 13 to the controller 
port 7A or 7B of the main unit 1 , and is designed to send 
sound signals from the microphone 1 7 to the main unit 
1 through such controller port 7A (or controller port 7B). 
[0033] While the foregoing head set 3 is designed to 
be connected to the main unit 1 through the controller 
port 7A or 7B, it is also allowable to design such head 
set 3 so as to be connected to the main unit 1 through 
the memory card slot 8A or 8B, or further through the 
USB connection terminal 5 or IEEE 1394 connection ter- 



minal 6. 

[0034] In short, any constitution is allowable provided 
that the head set 3 and the main unit 1 are connected 
with each other through an interface for supplying sound 
5 signals generated from the collected player's voice to 
the main unit 1, and an interface for supplying charac- 
ters' voices or effective sounds from the main unit 1 to 
the head set 3. 

[0035] Although the following explanation deals with 
10 the head set 3 designed for single-ear use, it should be 
noted that the binaural specification of such head set 3, 
like a general headphone, is also allowable. The sound 
emissive portion may have an inner-type earphone, 
which will be advantageous in reducing the size and 
15 weight of such head set. 

[0036] It should also be noted that while the head set 
3 herein is designed to be fitted on the player's head 
using the fitting arm 15, it is also allowable to provide a 
hook to be hung on either of the player's ears, to thereby 
20 allow the head set to be fixed on one side of the player's 
ear with the aid of such hook. 

Electrical Constitution of Main Unit 



25 [0037] The main unit 1 has, as shown in Fig. 2, a CPU 
100 for controlling signal processing or internal compo- 
nents based on various programs such as game appli- 
cation program, a graphic processor (GPU) 110 respon- 
sible for image processing, and an IO processor (IOP) 
30 120 responsible for interfacing of an external device 
such as the controller 2 and memory card with an inter- 
nal component within the main unit 1 . 
[0038] The main unit 1 also has a mechanical control- 
ler 190 responsible for reproducing and controlling an 
35 optical disk 1 30 such as DVD-ROM and CD-ROM which 
stores application programs or multi-media data, a main 
memory 1 60 having a function as buffer memory for tem- 
porarily storing data read out from a work area of the 
CPU 1 00 or the optical disk 1 30, a MASK-ROM 1 50 stor- 
ing operating system programs to be executed mainly 
by the CPU 100 and IOP 120, and a sound processor 
unit 1 40 (SPU) responsible for sound signal processing. 
[0039] The main unit 1 still also has a CD/DVD digital 
signal processor 1 70 (DSP) responsible for error cor- 
<*5 rection processing (CIRC processing) of reproduction 
output from the optical disk 130 supplied via an RF am- 
plifier 131, and responsible for expansion decoding of 
compressed coded data; a driver 180 and the mechan- 
ical controller 1 90 responsible for controlling rotation of 
5 ° a spindle motor, focusing/tracking of an optical pick-up, 
and loading operation of the disk tray 9; and a card-type 
connector 200 (PC card slot) for connecting a commu- 
nication card or an external hard disk drive. 
[0040] The individual portions are connected with 
55 each other mainly through bus lines 202, 203. The CPU 
100 and the graphic processor 110 are connected 
through a dedicated bus line, and the CPU 100 and the 
IOP 120 are connected through a sub-bus line (SBUS). 



4 



EP 1 226 853 A2 



8 



The IOP 120 and the CD/DVD digital signal processor 
170, MASK-ROM 150, sound processor unit 140 and 
card-type connector 200 are also connected through the 
SBUS. 

[0041] The CPU 100 controls the entire operations ot 
the main unit 1 by executing the operating system pro- 
gram for the main CPU stored in the MASK-ROM 150. 
The CPU 100 is also designed to control operation of 
the video game on such main unit 1 through executing 
various application programs loaded onto the main 
memory 160 after read out from the optical disk 130 or 
downloaded from a communication network. 
[0042] The IOP 120 executes the operating system 
program for the IOP stored in the MASK-ROM 150, to 
thereby enable input/output of signals sentf rom the con- 
troller 2 in response to the player's operation and data 
sent from the memory card storing various signals or 
game settings, input/output control of data at the USB 
connection terminals 5 and the IEEE 1394 connection 
terminal 6 and the PC card slot, and conversion of data 
protocol. 

[0043] The MASK-ROM 1 50 is designed to store de- 
vice IDs of the controller 2 connected to the controller 
ports 7A, 7B, head set 3, memory card inserted into the 
memory card slots 8A, 8B, and the PC card inserted into 
the card-type connector (PC card slot) 200. The IOP 1 20 
communicates with various devices such as the control- 
ler 2 and memory card based on the device IDs thereof, 
to thereby specify external devices such as controller 2, 
head set 3, and memory card connected to the main unit 

[0044] The graphic processor 110 performs drawing 
based on draw instruction issued by the CPU 1 00, and 
drawn image is stored in a frame buffer not shown. The 
graphic processor 1 1 0 also has a function as a geometry 
transfer engine responsible for processing such as co- 
ordinate transfer. 

[0045] That is, for the case that the application pro- 
gram of the video game or so stored in the optical disk 
130 uses so-called three-dimensional (3D) graphic, the 
graphic processor 1 10, as a geometry transfer engine, 
constructs a virtual three-dimensional object with a set 
of triangle polygons, and then performs various calcu- 
lations for generating an image possibly obtained by 
photographing such three-dimensional object with a vir- 
tual camera, that is perspective conversion for rendering 
(i.e., calculation of coordinate values of the verlexes of 
the individual polygons composing a three-dimensional 
image projected on to a virtual camera screen). 
[0046] The graphic processor 110 performs rendering 
of the three-dimensional object on the frame buffer 
based on a drawing instruction from the CPU 1 00, while 
using if necessary the geometric transfer engine. The 
graphic processor 110 is so designed to output video 
signals corresponding to such generated image. 
[0047] The sound processor unit 140 has an ADPCM 
decoding function for reproducing sound data which 
were processed by adaptive predictive coding, a repro- 



ducing function for reproducing and outputting effective 
sounds or the like by reproducing sound data stored in 
a sound buffer built in such unit 140 or externally at- 
tached thereto, and a modulation function for modulat- 
5 ing and reproducing sound data stored in the sound buff- 

[0048] The sound processor unit 140 thus provided 
. with such functions can be used as a so-called sampling 
sound source, which can generate sound signals such 
10 as those of music sounds and effective sounds from 
waveform data stored in the sound buffer based on in- 
structions from the CPU 100, 



constitution of Sound Data 
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[0049] Fig. 3 is a schematic chart showing an example 
of titles of waveform data read out from the optical disk 
130 and then stored in the sound buffer of the sound 
processor unit 140. As is known from Fig. 3, the enter- 
20 tainment system of this embodiment characterist»cally 
has two sets of sound data, that are sound data for 
speaker unit to be emitted from the speaker unit 42R, 
42L of the television receiver 40, and sound data for 
head set to be emitted from the head set 3 worn by the 
25 player. 

[0050] The sound data for speaker unit are composed 
of sound data with relatively large sound levels, which 
typically include, as shown in Fig. 3, firing sound of the 
arms used by the leading character, shout of enemy 
30 characters, background music (BGM) for battle scenes, 
theme music, explosive sound and attack sound. 
[0051] On the other hand, the sound data for head set 
are composed of sound data with relatively small sound 
levels which typically include, as shown in Fig. 3, 
35 speech sound of the leading character at a normal 
sound level, whispering sound of the leading character, 
footstep sound of the leading character, sound of charg- 
ing bullets to the arms by the leading character and 
sound of triggering. 
40 [0052] While the foregoing example dealt with the 
case that sound data for head set includes those related 
to the leading character with relatively small sound lev- 
els, the sound data may include other data with a rela- 
tively small sound levels such as growling sound and 
45 footstep sound of the enemy characters. 

[0053] in short, it is ail right that the sound data for 
speaker unit and head set are classified so as to add 
reality and presence of the video game. One possible 
measure for adding perspective of sounds to thereby im- 
50 prove reality and presence of the video game relates to 
assessing whole sound data from a viewpoint that how 
loud the individual sounds are audible by the leading 
character, and classifying those having relatively large 
sound levels into those for speaker unit, and those hav- 
55 ing relatively small sound levels into those for head set. 
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Overall Executive Operation of Video Game 

[0054] An entertainment device of this embodiment is 
designed to execute a battle-type video game described 
below. 

[0055] In this battle-type video game : a leading char- 
acter moves along a predetermined route, during which 
the leading character encounters with enemy charac- 
ters. Thus the player operates the controller 2 and also 
speaks to the leading character in the displayed scene 
through the microphone 7 of the head set 3 to encourage 
it or make suchleading character fight with enemy char- 
acters while giving instructions on the battle procedures. 
The player thus aims at the goal while defeating the en- 
emy characters in such fights. 

[0056] In the execution of such battle-type video 
game, the player turns on a main power source of the 
main unit 1. Upon supplying power to the main unit 1, 
the CPU 100 and the IOP 120 read out from the 
MASK-ROM 1 50 the operating system program for main 
CPU and operating system program for IOP, respective- 
ly, and by individually executing corresponding operat- 
ing system programs, the CPU 100 generally controls 
the individual portions of the main unit 1 , and the IOP 
120 controls input/output of signals typically between 
the controller 2 or head set 3 and memory card. 
[0057] Next, the player loads the optical disk 1 30 hav- 
ing stored therein such battle-type video game onto the 
main unit 1 , and then presses the start button 24 of the 
controller 2 to prompt the game start. 
[0058] When the game start is specified , the C PU 1 00 
reads out an application program of the video game and 
the foregoing sound data stored in the optical disk 130, 
loads the application program and game sounds into the 
main memory 160 and the sound processor unit 140, 
respectively, and executes such application program. ' 
[0059] While executing the game application pro- 
gram, the CPU 100 controls the graphic processor unit 
110 and sound processor unit 140 in response to in- 
structions of the players received via the IOP 120 from 
the controller 2 and headset 3 , to thereby control display 
of the images and emission of the effective sounds and 
music sound (BGM). 

[0060] The video game now allows the player not only 
to control the leading character through the controller 2, 
but also to control the leading character through voice 
input. 

[0061] Fig. 4 shows one scene of such game, in which 
a leading character 61 encounters with an enemy char- 
acter 62 during the travel along the travel route, and 
points arms 63, like a laser beam gun, at the enemy 
character 62. 

[0062] In such exemplary case, in order to make an 
advantageous fight of the leading character 61 over the 
enemy character 62, the player not only controls the 
controller 2, but also gives instructions to the leading 
character 61 through voice such as "Fire thrower!" so 
as to designate the arms to be used for attacking the 



enemy character 62, and such as "Aim at the belly!" so 
as to designate a weak point of the enemy character 62 
to be aimed at. 

[0063] The player's voice is picked up by the micro- 
5 phone 1 7 of the head set 3 5 and then supplied via the 
IOP 120 to the CPU 100 after converted into sound sig- 
nals. The CPU 1 00 analyzes meaning of the phrase spo- 
ken by the player based on waveform pattern of such 
sound signals, and controls display of behaviors of the 
10 leading character 61 based on the analytical results. 
[0064] In such exemplary case, in which the instruc- 
tions of "Fire thrower!" and "Aim at the belly! " were 
made by the player, the CPU 100 allows the controlled 
display as shown in Fig. 5 such that the leading charac- 
15 ter 61 holds a fire thrower as the arms 63 and throws 
fire to the enemy character 62 using such fire thrower 
to thereby expel it. 
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Sound Output Control 



[0065] Next, sound output control specific to the en- 
tertainment system of this 'embodiment will be de- 
scribed. Fig. 6 is a flow chart showing a process flow of 
the sound output control. Processes in this flow chart 
25 starts upon beginning of the video game, and in step S1 
the CPU 1 00 generates a game scene as shown in Figs. 
4 and 5, and creates controlled display thereof on the 
display screen 41 of the television receiver 40. Opera- 
tion of the CPU 100 then advances to step S2. 
30 [0066] In step S2, the CPU 100 controls the sound 
processor unit 140 so as t6 generate sounds corre- 
sponding to such game scene. The sound processor 
unit 140 generates sounds corresponding to such game 
scene based on the sound data (see Fig. 3) stored in 
35 the sound buffer, where the CPU 100 discriminates in 
step S3 whether the sounds generated by the sound 
processor unit 1 40 are those for head set 3 or not. If the 
sounds are found to be those for the head set 3 in step 
S3, process of the CPU 100 advances to step S4, and 
40 if for the speaker units 42R, 42L, to step S7. 

[0067] When the process advances to step S4 after 
the sounds generated by the sound processor unit 140 
are discriminated as those for the head set 3, the CPU 
100 supplies such sound signals generated by the 
^5 sound processor unit 1 40 to the sound emissive portion 
1 6 of the head set 3 worn by the player via the IOP 1 20. 
[0068] More specifically, the sound data for head set 
herein contain sounds data related to the leading char- 
acter having relatively small sound levels as described 
50 in the above, which are typically speech sound of the 
leading character at a normal sound level, whispering 
sound of the leading character, footstep sound of the 
leading character, sound of charging bullets to the arms 
by the leading character and sound of triggering. So that 
55 supplying such sound signals to the head set 3 will result 
in emission of sounds, such as whispering of the leading 
character 61 corresponding to the game scene gener- 
ated in step S1 , from the sound emissive portion 1 6 of 
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the head set 3. 

[0069] . Onthe other hand, when the process advanc- 
es to step S7 after the sounds generated by the sound 
processor unit 140 are discriminated as those for the 
speaker units 42R, 42L, the CPU 100 supplies such 
sound signals generated by the sound processor unit 
140 to the speaker units 42R, 42L of the television re- 
ceiver 40. 

[0070] More specifically, the sound data for speaker 
units herein contain sounds data having relatively large 
sound levels, which are typically firing sound of the arms 
used by the leading character, shout of enemy charac- 
ters, background music (BGM) for battle scenes, theme 
music, explosive sound and attack sound. So that sup- 
plying such sound signals to the speaker units 42R, 42L 
will result in emission of sounds, such as shout of enemy 
characters corresponding to the game scene generated 
in step S1 , from the speaker units 42R, 42L. 
[0071] After such controlling of the game sounds, 
process of the CPU 1 00 then advances to step S5, and 
whether the output of a series of sound signals from the 
head set 3 or speaker units 42R, 42L has been complet- 
ed is determined. If the output of the sound signals has 
not been completed., the process returns to step S4 or 
S7 in order to continue the supply of the sound signals 
to the head set 3 or the speaker units 42R, 42L. 
[0072] On the other hand, when the output of a series 
of sound signals has been completed, the process of 
the CPU 1 00 advances to step S6, and whether the en- 
tire game program was completed, or whether the end 
of the game was instructed by the player is determined. 
When the game over was detected, the execution of the 
routine expressed by the flow chart of Fig. 6 is terminat- 
ed, and when the game over was not detected, the proc- 
ess of the CPU 100 returns to step S1 in order to repeat 
the routine from steps S1 to S5 to thereby control the 
generation of the game scenes and emission of the 
game sounds. This allows repetitive generation of game 
scenes (step. S1) and game sounds corresponding 
thereto, which advances the battle-type video game. 

Effect of the Embodiment 
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[0073] As is clear from the above description, the en- 
tertainment system of this embodiment classifies the 
game sounds into those for the left and right speaker 
units 42R, 42L Of the television receiver 40, and those 
for the head set 3 worn by the player, and controls the 
emission of such sounds corresponding to the game 
scenes from the speaker units 42R, 42L, or from the 
sound emissive portion 1 6 of the head set 3. 
[0074] This allows the player to enjoy the video game 
while hearing footstep or whispering of the leading char- 
acter 61 closely from the head set 3, and hearing explo- 
sive sound or shout of the enemy characters 62 distantly 
from the speaker units 42R, 42L. 
[0075] In other words, there are two types of game 
sounds, those emitted from the speaker units 42R, 42L 



provided distantly from the player and those emitted 
from the sound emissive portion 16 of the head set 3 
provided closely to the player which successfully adds 
perspective to the game sounds, and improves reality 
and presence of the video game. 
[0076] While the foregoing embodiment dealt with the 
case in which the head set 3 was used as the sound 
emissive means, it is also allowableto use a microphone 
for collecting the player's voice and a separate speaker 
unit provided close to the player, in place of the forego- 
ing head set 3. Also such constitution can add perspec- 
tive to the game sounds, and can ensure similar effects 
as described in the above. 

[0077] Although particular embodiments have been 
described herein, it will be appreciated that the invention 
is not limited thereto and that many modifications and 
additions thereto may be made within the scope of the 
invention. Forexample, various combinations of the fea- 
tures of the following dependent claims can be made 
with the features of the independent claims without de- 
parting from the scope of the present invention. 
[0078] This application is related to Japanese Patent 
Application No. 2001-12356 filed on January 19, 2001, 
and No. 2001 -328998 filed on October 26, 2001 , based 
on which this application claims priority under the Paris 
Convention and the content of which is incorporated 
herein by reference. 



30 Claims 

1 . A sound control device comprising: 

a first sound output means provided at a pre- 
35 determined distance from a player; 

a second sound output means provided close 
to a player's ear; 

a classifying means for classifying whole 
sounds related to a video game into at least a 
40 first sound and a second sound; and 

a sound output control means for controlling 
output of the first sound through the first sound 
output means, and for controlling output of the 
second sound through the second sound out- 
45 put means, among sounds classified by the 

classifying means. 



25 



2. The sound control device according to Claim 1 , 
wherein the classifying means classifies sound hav- 
50 ing a predetermined sound level or higher as the 
first sound, and classifies sound having a sound lev- 
el lower than the predetermined sound level as the 
second sound. 

55 3. The sound control device according to Claim 1 or 
2, wherein the sound output control means controls 
output of at least effective sound and a background 
music of the game as the first sound, and controls 
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output of at least voice of a game character as the 
second sound. 

4. The sound control device according to Claim 1 , 2 or 

3, wherein the second sound output means provid- 5 
ed close to the player's ear is integrated with a 
sound collecting means for collecting player's voice. 

5. A sound control method comprising the steps of: 

w 

classifying whole sounds related to a video 
game into at least a first sound and a second 
sound; and 

controlling output of the first sound through a 
first sound output means provided at a prede- 15 
termined distance from a player and controlling 
output of the second sound through a second 
sound output means provided close to a play- 
er's ear, among sounds classified by the clas- 
sifying means. 20 

6. The sound control method according to Claim 5, 
wherein the classifying step comprises the steps of: 

classifying sound having a predetermined 25 
sound level or higher as the first sound, and 
classifying sound having a sound level lower 
than the predetermined sound level as the sec- 
ond sound. 

30 

. The sound control method according to Claim 5 or 
6, wherein the output controlling step comprises the 
steps of: 

controlling output of at least effective sound and 35 
a background music of the game as the first 
sound, and controlling output of at least voice 
of a game character as the second sound. 

The sound control method according to Claim 5, 6 40 
or 7, wherein the second sound output means pro- 
vided close to the player's ear is integrated with a 
sound collecting means for collecting player's voice. 

A computer-readable storage medium having re- 45 
corded therein a sound control program to be exe- 
cuted on a computer, wherein the sound control pro- 
gram comprises the steps of: 

classifying whole sounds related to a video 50 
game into at least a first sound and a second 
sound; and 

controlling output of the first sound through a 
first sound output means provided at a prede- 
termined distance from a player and controlling 55 
output of the second sound through a second 
sound output means provided close to a play- 
er's ear, among sounds classified by the clas- 



sifying means. 

10. The computer-readable storage medium having re- 
corded therein a sound control program according 
to Claim 9 S wherein the classifying step comprises 
the steps of: 

classifying sound having a predetermined 
sound level or higher as the first sound, and 
classifying sound having a sound level lower 
than the predetermined sound level as the sec- 
ond sound. 

11 . The computer-readable storage medium having re- 
corded therein a sound control program according 
to Claim 9 or 1 0, wherein the output controlling step 
comprises the steps of: 

controlling output of at least effective sound and 
a background music of the game as the first 
sound, and controlling output of at least voice 
of a game character as the second sound. 

12. The computer-readable storage medium having re- 
corded therein a sound control program according 
to Claim 9, 10 or 11, wherein the output controlling 
step through the second sound output means com- 
prises the step of: 

controlling output of the second sound through 
the second sound output means integrated with 
a sound collecting means for collecting player's 
voice and provided close to the player's ear. 

13. A program execution device for executing a sound 
control program wherein the sound generation pro- 
gram comprises the steps of: 

classifying whole sounds related to a video 
game into at least a first sound and a second 
sound; and 

controlling output of the first sound through a 
first sound output means provided at a prede- 
termined distance from a player and controlling 
output of the second sound through a second 
sound output means provided close to a play- 
er's ear, among sounds classified by the clas- 
sifying means. 

14. A sound control program.to be executed on a com- 
puter comprising the steps, of: 

classifying whole sounds related to a video 
game into at least a first sound and a second 
sound; and 

controlling output of the first sound through a 
first sound output means provided at a prede- 
termined distance from a player and controlling 
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output of the second sound through a second 
sound output means provided close to a play- 
er's ear, among sounds classified by the clas- 
sifying means. 
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FIG. 3 
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FIG. 4 
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